The concavity of Rènyi entropy power
نویسندگان
چکیده
We associate to the p-th Rényi entropy a definition of entropy power, which is the natural extension of Shannon’s entropy power and exhibits a nice behaviour along solutions to the p-nonlinear heat equation in Rn. We show that the Rényi entropy power of general probability densities solving such equations is always a concave function of time, whereas it has a linear behaviour in correspondence to the Barenblatt sourcetype solutions. This result extends Costa’s concavity inequality for Shannon’s entropy power to Rényi entropies.
منابع مشابه
On the analogue of the concavity of entropy power in the Brunn-Minkowski theory
Elaborating on the similarity between the entropy power inequality and the Brunn-Minkowski inequality, Costa and Cover conjectured in On the similarity of the entropy power inequality and the BrunnMinkowski inequality (IEEE Trans. Inform. Theory 30 (1984), no. 6, 837-839) the 1 n -concavity of the outer parallel volume of measurable sets as an analogue of the concavity of entropy power. We inve...
متن کاملAn information-theoretic proof of Nash's inequality
We show that an information-theoretic property of Shannon's entropy power, known as concavity of entropy power [7], can be fruitfully employed to prove inequalities in sharp form. In particular, the concavity of entropy power implies the logarithmic Sobolev inequality, and the Nash's inequality with the sharp constant.
متن کاملA short proof of the "Concavity of entropy power"
We give a simple proof of the “concavity of entropy power”.
متن کاملCortical Entropy Values Correlate with Brain Scale-free Dynamics
A two-dimensional shadow may encompass more information than its corresponding three-dimensional object. If we rotate the object, we achieve a pool of observed shadows from different angulations, gradients, shapes and variable length contours that make it possible for us to increase our available information. Starting from this simple observation, we show how informational entropies might turn ...
متن کاملSelf-Similar Solutions of Rényi's Entropy and the Concavity of Its Entropy Power
We study the class of self-similar probability density functions with finite mean and variance, which maximize Rényi’s entropy. The investigation is restricted in the Schwartz space S(R) and in the space of l-differentiable compactly supported functions C l c(R). Interestingly, the solutions of this optimization problem do not coincide with the solutions of the usual porous medium equation with...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- IEEE Trans. Information Theory
دوره 60 شماره
صفحات -
تاریخ انتشار 2014